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Abstract 

Consensus problem of high-order integral multi-agent systems under switching directed topology is 



[/3 ■ considered in this study. Depending on whether the agent's full state is available or not, two distributed 

O 

protocols are proposed to ensure that states of all agents can be convergent to a same stationary value. 

In the proposed protocols, the gain vector associated with the agent's (estimated) state and the gain 

> : 

^vq . vector associated with the relative (estimated) states between agents are designed in a sophisticated 



way. By this particular design, the high-order integral multi-agent system can be transformed into 
a first-order integral multi-agent system. And the convergence of the transformed first-order integral 
agent's state indicates the convergence of the original high-order integral agent's state if and only if 
all roots of the polynomial, whose coefficients are the entries of the gain vector associated with the 
relative (estimated) states between agents, are in the open left-half complex plane. Therefore, many 
analysis techniques in the first-order integral multi-agent system can be directly borrowed to solve the 
problems in the high-order integral multi-agent system. Due to this property, it is proved that to reach 
a consensus, the switching directed topology of multi-agent system is only required to be "uniformly 
jointly quasi-strongly connected", which seems the mildest connectivity condition in the literature. In 
addition, the consensus problem of discrete-time high-order integral multi-agent systems is studied. 
The corresponding consensus protocol and performance analysis are presented. Finally, three simulation 
examples are provided to show the effectiveness of the proposed approach. 
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Index Terms 

Multi-agent systems, high-order integral agent, linear dynamics, switching directed topology, con- 
sensus. 

I. Introduction 

Recent years have witnessed a rapid development on the consensus or state agreement of 
multi-agent systems due to its central role in distributed coordination tasks. Roughly speaking, 
the consensus problem means that the states of all agents are convergent to a same value in 
a distributed manner. In control community, considerable research efforts have been made to 
address this problem from different aspects such as the dynamics of agent [HI, [IH, connectivity 
of communication topology [|3J, and communication constraints H, [|5l. It is noted that for the 
convenience of studying the last two aspects, most results assume that the agent is modeled by 
the first-order/second-order integral dynamics. However, due to the diversity of real-world agents, 
these simple dynamics are insufficient to fully describe the agent's dynamical behavior. To fill 
this gap, an intuitive way is to investigate the agent described by the high-order integral/general 
linear time-invariant dynamics first. 

In the literature, consensus problems of high-order integral/linear multi-agent systems have 
been addressed in [|6l- [|23l . to name a few. Some early results are presented in [|6l where a state- 
feedback based consensus protocol is proposed for linear time-invariant multi-agent systems 
under fixed communication topology. Since the full state of linear agents may be unavailable in 
some scenarios, several output-feedback based consensus protocols have been proposed as well, 
for example, the static output-feedback based protocol [7] and the dynamic output-feedback based 
protocols [8J. And the consensusability of linear multi-agent systems under these output-feedback 
protocols is analyzed. In BH, [fTOl . uncertainties in the dynamics of high-order integral/linear 
agents are considered, and the consensus can still be achieved by employing the internal model 
approach and the neural-network-based adaptive approach, respectively. An interesting leader- 
following consensus protocol is proposed for linear multi- agent systems in [fTTI . Furthermore, 
in [fT2l, [fT3l, the relationship between the consensus of high-order integral/linear multi-agent 
systems and the synchronization in complex networks is discussed, and the concept of consensus 
region is introduced. In addition, there are also some papers considering the consensus of high- 
order integral/linear multi-agent systems with communication constraints such as communication 
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noises lfT4ll . communication delays [15|, and quantization effect [[T6ll . It is noted that all above 
results assume that the multi-agent system works under fixed communication topology. However, 
in some applications of mobile agents, the creation and loss of communication links frequently 
occur due to the sensor's limited working region. Therefore, the study on the consensus of 
high-order integral/linear multi-agent systems under switching topology is of more practical use. 

Some attempts in this direction have been made in [[T7l - [|23l . One common assumption of these 
papers is that the topology needs to be undirected, which requires the bidirectional information 
exchange between agents. Furthermore, in [fTTl . the communication topology is required to be 
"frequently connected" rather than "jointly connected". In [[T8l - [|20ll . to design the control gain, 
the eigenvalues of graph Laplacian matrix (a certain global information) should be known. In 
[|2n . [|22l . the result is highly dependent on the doubly stochastic property of Laplacian matrix 
of undirected graph. In [1231 . the consensus tracking problem of linear multi-agent systems under 
switching topologies is investigated, however, all agents need to know the system matric in the 
so-called exosystem which generates the tracking reference signal. It is also noted that consensus 
of first-order integral multi-agent systems with switching directed topology has been extensively 
studied. The mildest connectivity condition on the switching directed topology seems "uniformly 
jointly quasi- strongly connected" [|24l . [|25l . Then a question arises consequently: is it possible 
to obtain the counterpart result in the high-order integral /linear multi-agent systems? 

This paper tries to give a positive answer to the above question. Two novel protocols, the 
state-feedback based protocol and the output-feedback based protocol, are proposed to solve the 
consensus problem of continuous-time high-order integral multi-agent systems. By the proposed 
protocol, it is interesting to find that the original high-order integral multi-agent system can be 
transformed into a first-order integral multi-agent system. And the convergence of the transformed 
first-order integral agent's state implies the convergence of the high-order integral agent's state if 
and only if all roots of the polynomial, whose coefficients are the entries of control gain vector 
of the proposed protocol, are in the open left-half complex plane. Therefore, most results in the 
first-order integral multi-agent system can be generalized to the high-order integral multi-agent 
system directly. Then it is proved that the connectivity condition on the consensus of high- 
order integral multi-agents under switching directed topology is that the switching topology is 
uniformly jointly quasi-strongly connected. To the best of the authors' knowledge, it seems the 
mildest connectivity condition in the literature of high-order integral multi-agent systems. In 
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addition, results obtained in the continuous-time domain can be extended to the discrete-time 
domain as well. Finally, the theoretical analysis is validated by three illustrative examples. 

The reminder of this paper is organized as follows. Section |II] introduces the problem formu- 
lation and some preliminary results. Section III] presents the consensus protocol for high-order 
multi-agent systems in the continuous-time domain and gives the corresponding performance 
analysis. Section |IV] extends the results in the continuous-time domain to the discrete-time 
domain. Illustrative examples are provided in Section |V] Section |Vl] concludes this paper with 
final remarks. 

The following notations are used throughout this paper: M denotes the set of real numbers; N 
denotes the set of natural number; 1„, = (1, ■ ■ ■ , 1)^ e M"; 0„ = (0, ■ ■ ■ , 0)^ G M"; C^ = -^^^Zky-, 
In denotes the n x n dimensional identity matrix; (g) denotes the Kronecker operator; For a 
given matrix X, X^ denotes its transpose; ||X||2 denotes its Euclidean norm; \\X\\p denotes its 
Frobenius norm. 

IL Problem Formation and Preliminaries 

In the literature, the graph theory is commonly employed to describe the communication among 
agents. Let Q = {Vg, Sg} be a digraph where Vg = {f i, ■ ■ ■ , vn} is the node set and Sg C VgxVg 
is the edge set. The ith agent in the network is represented by the node fj. The edge Cij starting 
from Vj to Vi belongs to £g if and only if the ith agent can receive information from the jth agent. 
In this paper, it is assumed that there is no self-edge in the graph, i.e., en ^ £g,i = 1,- ■ ■ , N. 
The neighbor set of the ith agent is defined as Mi = {vj E Vg\eij E Eg}. A directed path in Q 
is a sequence of distinct nodes Vi-^,Vi^, ■ ■ ■ , Vi^ such that Ci^^-^i^ E £g, s = 1, ■ ■ ■ , m — 1. The 
directed graph Q is called strongly connected if for any two distinct nodes Vi and Vj there is a 
directed path starting from Vj to fj. A node is called a center/root if there are directed paths 
starting from this node to any other nodes in Vg. The directed graph Q is called quasi-strongly 
connected if Q has at least one center node. 

Due to the link failure and packet loss, the communication channel of multi-agent systems 
is usually time-variant. Therefore, it is assumed in this paper that the communication topology 
is modeled by a set of graphs Q^(^t) = {^g^^g^a)}- ^(0 • [0)^^) — ^ 5 is a piecewise constant 
function whose value at time t is the index of the graph representing the agent's communication 
topology at time t. S denotes the index set of all possible graphs and S has finite elements 
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because the node set Vg is a finite set. The following assumption is applied to the switching 
signal o'(-), which means that the communication topology does not change too fast. 

Assumption 1: Let (tg, ti, ■ ■ ■ ) be the sequence of time points at which the piecewise constant 
function a(t) switches. The dwell times Tj = tj+i — tj (i = 0, 1, ■ ■ ■ ) have a uniform lower bound 
rD>0. 

The union graph of g^^t) over the time interval [ti, t2) is defined as ^[f^.tj) = (Vg, Ute[ti,t2) ^GAt)) 
One concept on the connectivity of the union graph is given in the following. 

Definition 1: Q„(t) is said to be uniformly jointly quasi- strongly connected if there exists a 
constant T > such that Q^t,t+T) is quasi-strongly connected for any t > 0. 

The above section introduces the communication topology of the network of N agents. The 

other essential part of modeling the multi-agent system is the agent's dynamics. In this paper, 

the dynamical behavior of each agent is described by the following m-dimensional high-order 

integral dynamics 

f 



< 



(1) 



which can be written in the compact form 

Xi{t) = Ax,{t) + Bu^{t), 

B = (0, ■ ■ ■ , 0, 1)^, Xi{t) = (a;,,i(t), ■ ■ ■ , Xi,m{t)f ■ (2) 

The control objective is to solve the distributed consensus problem of this high-order integral 
multi-agent system which is defined as follows. 

Definition 2: The multi-agent system is said to reach a consensus if under certain protocol 
Ui{t), there exists a vector x* E R™ such that 

Um Xi(t) = X* , i = 1,- ■ ■ ,N. 

If the consensus protocol Ui(t) only employs the information from the neighbor agents j E Mi, 
then this protocol is called a distributed consensus protocol. 
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Before closing this section, the following result on the robust consensus of first-order integral 
multi-agents is provided f25\ . 

Lemma 1: For the first-order integral multi-agent system with external disturbances 

r,(t)= Yl <*)(^.W-^*W)+^^W' ^ = l,■■■,N, (3) 

j6M(<T(t)) 

where rj(t) G M denotes the state of the zth first-order integral agent, A/'j(cr(t)) denotes the 
neighbor set of agent i at time t, a^,^. > is the weight constant associated with the edge 
Cij in graph Qa{t), and Wj(t) G M is the continuous disturbance signal. For Vrj(O) and Vu;j(t) 
satisfying sup^gp^oo) l^i(^)l < ^ and limt^oo Wi(t) = 0, then hmt^^{ri{t) - rj{t)) = if Q^(t) 
is uniformly jointly quasi- strongly connected; 

Proof: See the proof of Proposition 1 in [l25l . ■ 



III. Consensus Protocol and Related Analysis 

A. State-Feedback Based Consensus Protocol 

In this subsection, it is assumed that the full state information of each agent is available 
for designing the consensus protocol. Inspired by the results presented in [14], the following 
consensus protocol is proposed 

Ui{t) = KiXi{t) - Yl ^%)K2ixi{t) - Xjit)), (4) 

jeM{fT(t)) 

where Ki = (0, -ai, -as, ■ ■ ■ , -a^-i) G K^^™ and K2 = (ai, 03, ■ ■ ■ , dm-i, 1) G K^"""- The 

parameters (ai, ■ ■ ■ , flm-i) are constant control gains to be designed later, a^.^s is defined in ([3]). 

Substituting dH) into © obtains that 

X{t) = {In ® (A + BK,) - Lg^^^^ ® {BK2))X{t), (5) 

where X{t) = {xj{t),--- ,a;^(t))^, the off-diagonal entry (i,j) of Lg^^^^ is —a^^u., and the 
diagonal entry {i,i) of Lg^ is J2j£j\fi(a(t)) ^^a(t)- ^^^^ ^Sryit) ^^ called the Laplacian matrix of 
the graph ^^(i). 
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Let X{t) = (In ® K2)X{t) = (xi(t), ■ ■ ■ ,XAr(t))^ G M^, then multiplying (In ® K2) at the 
both sides of (O obtains that 

l(t)= (/^ ® K^iA + BK^) - Lg^^^^ ® {K2BK2))X{t) 

= -(Lg^(,, ® 1)(/^ ® ir2)X(t) = -Le^„X(t). (6) 

From dD, it is interesting to find that under the proposed protocol, the original high-order 
integral multi-agent system has been transformed into a first-order integral multi-agent system. 
Before proceeding with proving that Xi{t) = K2Xi{t) {i = 1,- ■ ■ , N) can reach a consensus, we 
should first study whether the convergence of Xj(t) implies the convergence of Xi{t), which is 
answered by the following lemma. 

Lemma 2: Consider the following non-homogeneous linear differential equation 

where r(t) G R and /(t) G M is a continuous function satisfying hiat^oo fit) = /*• Let the 
characteristic equation associated with <^} be 

s""-' + arn-is""-^ + ■ ■ ■ asS + ai = 0. (8) 

Then, for any initial state (r(0), ■ ■ ■ , r('^~^)(0)), (r(t), ■ ■ ■ , r('^~^)(t)) are convergent if and only 
if all roots of ([8]) are in the open left-half complex plane. In addition, lira {r(t),r^^\t), ■ ■ ■ ,A'^^'^\t)) 

t—^co 

(/7ai,0,---,0). 

Proof: See the proof in the Appendix. ■ 

Then the following main result can be obtained by Lemmas \T\ and [21 

Theorem 1: The proposed protocol defined by dU can solve the consensus problem of high- 
order integral multi-agent systems if all roots of (jS} are in the open left-half complex plane and 
the communication topology Qcr{t) is uniformly jointly quasi- strongly connected. 

Proof: First, if Qo-{t) is uniformly jointly quasi-strongly connected, by (|6]) and Lemma [H 
it follows that for Vxj(0),Xj(0), limt^oo(a;i(^) — Xj{t)) = 0, because Ui{t) = satisfies the 
conditions required in Lemma [H 

Next, it is proved that there exists x* such that lim(_^oo Xi{t) = x*, i = 1, ■ ■ ■ , A^ if and only if 
liiRt^ 00 {xi{t) —Xj{t)) = 0,yi,j = I,- ■ ■ , N. The sufficiency is obvious. To prove the necessity, 
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let Xinax(^) = max{xi(t), ■ ■ ■ ,XN{t)} and Xmin(t) = min{xi(t), ■ ■ ■ ,X7v(i)}- By ^, it follows 
that a;max(^) < and Xmml^) > 0, Vt > 0. This together with lim.t-^aoixi{t) — Xj{t)) = lead to 
that there exits x* such that limt^oo Xi{t) = x* , i = 1, ■ ■ ■ , N . 

If all roots of ^ are in the open left-half complex plane, it can be obtained by Lemma [2l 
that \imt^ooXi{t) = x*, i = I,- ■ ■ , N where x* = (x*/ai, 0, ■ ■ ■ ,0)^, which means that the 
proposed protocol can solve the consensus problem. In addition, "all roots of ([8]) are in the open 
left-half complex plane" is also necessary for solving the consensus problem by the necessity 
proof of Lemma |2l ■ 

Remark 1: The most interesting feature of the consensus protocol defined by ([H) is that under 
the proposed protocol, the consensus problem of high-order integral multi-agent systems is 
equivalent with the consensus problem of first-order integral multi-agent systems. Therefore, 
many existing results (for example, the consensus problem with delayed communication [26J) 
in the literature can be generalized to the high-order integral case directly. 

Remark 2: The group decision value x* is determined by two factors: the agents' initial states 
and the communication topology Qa(t) ■ In the switching topology case, it is usually hard to give an 
explicit solution to x*. However, if ^^-(t) is balanced at any time (the graph Qcr(t) is called balanced 
if l^Lg^^^^ = 0?,), then by ®, l^X(t) = -l^Lg^,,,X(t) = 0?^. Hence l^X(t) = 1?;X(0). This 
together with lim^^oo Xi{t) = x*, i = 1,- ■ ■ , N leads to S* = ^ Xlili ^i(O) = f Si^i ^2Xi{0). 
Thenx* = (^Eti^2X.(0),0,---,0r. 

B. Output-Feedback Based Consensus Algorithm 

In this subsection, it is assumed that the agent's full state is not available any more. Instead, 
only the agent's output can be used for the consensus protocol design, which is modeled by the 
following equation 

y,{t) = Cx,{t), (9) 

where C = (ci, ■ ■ ■ , Cm)- Here it is assumed that the pair {A, C) is detectable. 

Motivated by the dynamic output feedback consensus protocol proposed in [[8l, the following 
protocol is proposed 

u,{t) = K,Si{t) - Yl <i)^2(si(t)-s,(t)), (10a) 

s,{t) = {A + K3C)s,{t) + Bu,{t) - K,y,{t), (10b) 

April 16, 2013 DRAFT 



where Ki and K2 are defined in dH), K^ E W^^^ is designed in such a way that A + K^C is 
Hurwitz. The basic idea behind this protocol is that design an observer (|10bl ) to dynamically 
estimate the agent's full state, and then use the estimated state to replace the actual state in dH), 
which results in (llOal ). 

By © and (|10bl) . it follows that 

d{xi{t) - Si{t))/dt ={A + KsC)ixiit) - Siit)). 

Then 

Xi{t) = Si{t) + exp((A + K3C)t){xi{0) - Si{0)). (11) 

Since A + K3C is Hurwitz, it can be proved that Hmt^oo(a^i(i) — ^^(t)) = 0. Therefore, to prove 
that Xj(t) {i = 1,- ■ ■ , N) can reach a consensus is equivalent to prove that Si{t) (i = 1,- ■ ■ , N) 
can reach a consensus. Substituting (fTTI) into (|10bl) obtains that 

- (/;v 8) iK,Cexp{{A + ir3C)t)))(X(0) - 5(0)), (12) 

where S{t) = {sj{t), ■ ■ ■ , sjj{t))^ and X(t) is defined in ©. 

Similarly, let S{t) = {In (g) K2)S{t) = (si(t), ■ ■ ■ , SN{t)f G M^, then multiplying (/^ ^fsTa) 
at the both sides of (fT3l) obtains that 



5(t) = -(/^ ® (ir2K3Cexp((A + KsC)t)))iX{0) - Sm 

-Lg^„S(t)^-Lg^„S(t)+a;(t), (13) 

where cu{t) = (u;i(t), ■ ■ ■ , W7v(t))^ and coi{t) = {K2K3C exp{{A + K3C)t)){xi{0) - Si(0)). 

From (fT3l) . the original consensus problem has been transformed into the robust consensus 
problem of first-order integral multi-agent systems. Similar with the method employed in Theo- 
rem \T\ the following result shows that the output-feedback based consensus protocol defined by 
(flOl) can also solve the consensus problem under the same conditions of Theorem \T\ 

Theorem 2: Assume that A + K^C is Hurwitz. The proposed protocol defined by (fTOl ) can 
solve the consensus problem of high-order integral multi-agent systems if all roots of ([8]) are 
in the open left-half complex plane and the communication topology Q^(^t) is uniformly jointly 
quasi- strongly connected. 
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Proof: First, let $s(t, s) be the state transition matrix of (fUt . Due to Assumption [T] $5(t, s) 
can be written as 

$5(t, s) = exp(-Lg^(^^) (t - tp)) exp(-Lg^j^^_^j {tp - tp_i)) 

X • • • X exp(-Lg^(^^, (tg+i - s)), t > s, (14) 

where tp is the largest time switching point smaller than t and tq is the largest time switching 
point smaller than s. In [|27ll . it has been proved that for any A > 0, exp(— Lg^ A) is a stochastic 
matrix. Then $5(t, s) is also a stochastic matrix. Therefore, ||$5(t, s)\\f < A^^, Vt > s. 

If ^^(4) is uniformly jointly quasi- strongly connected, by the same analysis in the proof of 
Theorem [U the solution to the homogeneous differential equation associated with (fT3l) . S{t) = 
—Lg^S{t), is convergent under any initial states. Therefore, there exists a matrix $^ such that 
limt^oo '^5(^,0) = ^. 

The solution to (fT3l) can be written as 

S{t) = $5(t, 0)^(0) + / <l>s{t, sMs)ds. (15) 

Next, let /ii,--- , Urn be the eigenvalues of A + K^C. Then u)k{t) in (fT3l) is the linear 
combination of t-'e^'*, i,j = 1, ■ ■ ■ ,m. Since the real parts of /ii, ■ ■ ■ ,yUm are all in the open 
left-half complex plane, it can be proved that liiat^oo P e'^^^ = and f^Pe'^^^dt < 00. Then 
supjg[o,oo) I'^fcli^)! < 00, Um(^oo^fc(^) = and f^ \ijjk(t)\dt < 00, k = 1,- ■ ■ ,N. It is assumed 
that Jg°° ||a;(t)||2(it < M. Then for any e > 0, there exists Ti such that J^ \\u{t)\\2dt < e. Due to 
the convergence of $5(t, 0), for any e > 0, there exists T2 > Ti such that for any h > t2 > T2, 
||$5(ti,ri) — ^§{t2,Ti)\\F < e. Then the convergence of S{t) can be proved by the Cauchy's 
Convergence Theorem. That is 

\\S{h) - Sit2)\\2 <\\<^situO) - ^s{t2,0)y\\Sm2+ f ' \\<^s{tus)-^s{t2,s)yMs)\\2ds 

Jo 

+ \\^situs)-^sih,s)\\FMs)\\2ds+ \\^sit2,s)\\FMs)\\2ds 

JTi Jti 

<\\S{0)\\2N^e + 2N^Me + 2N\ + Nh. (16) 

Since Umi^oo ^fc(i) = 0, A; = 1, ■ ■ ■ , A^, by LemmafU it follows that limi^oo(sj(t) — Sj(t)) = 
if ^^(4) is uniformly jointly quasi-strongly connected. This together with the convergence of S{t) 
lead to that there exists s* such that lim^^oo Si{t) = s* , i = 1, ■ ■ ■ , N . Because A + K^C is 
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Hurwitz, limt^oo K2Xi{t) = \imt^^K2Si{t) + \imt^^K2exp{{A + K3C)t){xi{0) - 5^(0)) = 
limt^oo Si{t) = s*,Wi = 1,- ■ ■ , A^. If all roots of ^ are in the open left-half complex plane, by 
Lemma [21 it can be obtained that limt^oo Xi{t) = (s*/ai, 0, ■ ■ ■ ,0), i = 1,- ■ ■ , N, which closes 
the proof of this theorem. ■ 

C. General Linear Time-Invariant Multi-Agent Systems 

Consider the multi-agent system composed of the following general continuous -time linear 
time-invariant dynamical agent 

Xi{t) = AgXi{t) + BgUi{t), yi{t) = CgXi{t), z = 1, ■ ■ ■ , AT, (17) 

where Xi{t) G W^, Ag G M'^x", Bg G M™, and Cg G R"" (Cg is a row vector). 

If the pair {Ag, Eg) is controllable and the pair (Ag, Cg) is detectable, by Luenberger control- 
lable canonical, there exists a matrix T„ G W^^"^ such that 



/O 1 




A. 



Let On 



[ttg, ttg, 



T.AgT;' 



-,m\T 





1 











\al al 



B„ 



TgBg 



kj 



/o\ 




VJ 



(18) 



'""S 



. Then, by the similar proof of Theorem |2] the following protocol 
can solve the consensus problem of general linear multi-agent systems (flTl) if all roots of ([8]) are 
in the open left-half complex plane and the communication topology Q^(^t) is uniformly jointly 
quasi-strongly connected. 

u,it) = -a^T-'s,it)+K^T-\s,it)- >; a';:,,,K2T,-\s.it) - s,it)), (19a) 



E <,)^2T-i(..(t)-3,(t)), 
ieM(^(t)) 
Si{t) = {Ag + KsCg)siit) + Bgu,{t) " K^yiit), 



(19b) 



where Ki and K2 are defined in dU, and K3 satisfies that Ag + K^Cg is Hurwitz. 

IV. Extensions to Discrete-Time High-Order Integral Multi-Agent Systems 

The results obtained in the continuous-time domain can also be extended to the discrete-time 
case. Assume that the ith agent is described by the following discrete-time high-order model 

Xi [A; + 1] = Axi [k] + Bui [k] , (20a) 

y,[k] = Cx,[k], (20b) 
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where Xi[k] = (xj_i[A;], ■ ■ ■ ,Xi^jn[k])'^ G M™, Ui[k] G M and yi[k] G M are the agent's state, input 
and output at the fcth step, respectively. The system matrices A, B and C are defined same as 
the ones in © and Q. 

The dynamic-output feedback based consensus protocol is proposed as follows 

Ui [k] = K^Zi [k] - — — — ^ a;^^^^ K^ {zi [k] - zj [k] ) , (21a) 

z,[k + 1] = {A + K(,C)z,[k] + Bu,[k] - K^yAkl (21b) 

where a[k] denotes the index of the graph representing the agent's communication topology at the 
kih. step; Qa[k], A/i[cr[A;]] and a^-'^, have the similar meanings as the ones defined in the continuous- 
time case; K^ = {bi,b2-bi,- ■ ■ , bm-i - &m-2, 1 - &m-i) G R^"""", K^ = (fe^, 63, ■ ■ ■ , &m-i, 1) G 
j^ixm ^j^^ ^^ ^ R™^i is designed in such a way that all eigenvalues oi A + KqC are in the 
unit circle. 

By (l21bL it follows that 

Zi[k + 1]-Xi[k + 1] = {A + KeC)izi[k] - Xi[k]), (22) 

which results in 

Zi[k] = iA + KQC)\zi[0] - Xi[0]) + Xi[k]. (23) 

Then substituting (|21al) and (|23l) into (I21b|) obtains that 

Z[A; + 1] = (/at ® (A + 5ir4))^[A;] - (^[A;] ® BK5)Z[k] 

+ {Ir, ® (i^eClA + K,C)'')){Z[0] - X[0]), (24) 

where Z[k] = {zl[k], ■ ■ ■ , z%[k]f, the (i, i)-entry of S[k] is (EjeMkW] "^W^/^^ + ^jem-M "-[fc]) 
and the («, j)-entry (i ^ j) of S[/c] is -{a'^^^^)/{l + EjeM[-[fc]] "-[fc])- 

Similar with the continuous-time case, multiplying /jv K^ at both sides of (|24)) obtains that 



Z[A; + 1] = (/;v - S[k])Z[k] + u;rf[A:], (25) 

where Ud[k] = {In ® {K^K^C{A + A^6C)'=))(Z[0] - X[0]), Z[A;] = (^i[fc],--- ,^7vM)^ and 
z,[fc] = iTs^afc] (2 = l,---,iV). 

From (|25T ). it can be seen that the original discrete-time high-order integral multi-agent system 
has been transformed into a discrete-time first-order integral multi-agent system with a vanishing 
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disturbance. Similar with the continuous-time case, in the following section, this reduced-order 
multi-agent system is proved to reach a consensus first, and then the consensus of the original 
multi-agent system can be ensured provided certain condition is applied to (61, ■ ■ ■ , &m-i)- 

Lemma 3: The discrete-time first-order integral multi-agent system defined by (|25] ) can reach a 
consensus if ^^[fc] is uniformly jointly quasi-strongly connected in the discrete-time sense. (Ga[k] 
is called to be uniformly jointly quasi-strongly connected in the discrete-time sense if there 
exists a constant M > such that the union graph (Vg, Uiejfc k+i ■■■ k+M} ^G<y[i\) i^ quasi-strongly 
connected for any A; > 0.) 

Proof: Let the state transition matrix of (|25T ) be 



k=i 

It is easy to verify that Vfc = 0, 1, ■ ■ ■, /at — S[k] is a stochastic matrix with positive diagonal 
elements. Therefore, <^d{j,i) is also a stochastic matrix, which implies that ||$d(j, i)||ir < A^^, 

Vj > i > 0. Then the solution to (ES]) is 

fc-i 
Z[k] = ^d{k, 0)Z[0] + Y, ^d{k, i)ujd\i]. (27) 

Next, two mathematical operators are defined, which play a key role in analyzing the convergence 

of Z[k]. For a stochastic matrix P = {Pij} e R^^^, define t{P) = 0.5 max^j J^^^i \Pis - Pjs\- 
For a vector p = {pi, ■ ■ ■ ,PnY ^ ^^^' define Ap = maxjj |pj — pj\. By [28J, for any vector 
ri G M^ and stochastic matrix P G M^^^, if r2 = Pri, then Ar2 < r(P)Ari. Therefore it can 

be obtained that 

fc-i 

AZ[A;] <r(<l>rf(A;,0))AZ[0] + ^r(<l>d(A;,2))Ac^42]. (28) 

i=0 

By Lemma 3.9 in [l24l| and Theorem 3.1 in J29l, the following properties hold for the state 
transition matrix $(i(-, ■). That is: if the communication topology Qa[k] is uniformly jointly quasi- 
strongly connected in the discrete-time sense, then 

• there exists a vector c G M^ satisfying l^c = 1 such that Imvt^ao ^dit, 0) = Inc^', 

. for any integers k,h>0, there exist Cm > and < A$ < 1 such that T{<^d{k + h, k)) < 
Cm^<i,- 

Let the maximal magnitude eigenvalue of A + KqC be Xmax- Since all eigenvalues of A + KqC 
are in the unit circle, then |Amaa;| < 1. And there must exist a constant Cg such that A{ujd[k]) = 
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A((/^ ® {K^K^C{A + KeC)'')){Z[0] - X[0])) < C^lXma.]". Therefore, 
fc-i fc-i 

J]r($rf(fc,z))Ac^4z] < J2CMCAi-'\Xma.\' <{k- l)CMCe|A™„|^ (29) 

j=0 i=0 

where |Amm| = max{A<j,, \Xmax\} < 1- Then 

fc-i 
lim\2r{<l>d{k,i))AuJd\t] = 0, (30) 

fc— >oo •^— ' 
i=0 

which results in that 

k-i 
lim AZ[k] < Urn r($d(fc, 0))AZ[0] + lim J" T{^d{k,i))AuJd[i\ = 0. (31) 

fc— ^oo A;— >-oo fc— >oo ^— ^ 

By the definition of the operator A, it follows that Wk > 0, AZ[A;] > 0. This together with (1311 
leads to 

lim {zi [k] - Zj [k]) = 0, VI < i, j < A^. (32) 

fc— ^oo 

Similar with Theorem |2l the convergence of Z[k] is proved in the following part. From one 
side, since all eigenvalues of A + K^C are in the unit circle, it is easy to prove that there exists 
a constant Md such that Xli^o ll'^f^Wlb < ^d- Therefore, Ve > 0, there exists Mi > such 
that Yl'^K \\^d[i]\\2 < e- From the other side, because of the convergence of $(i(A;,0), Ve > 0, 
there exists Mg > Mi such that for any fci > ^2 > M2, \\^d{ki,Mi) - ^^(fca, Mi)||ir < e. By 
the above two facts, the convergence of Z(t) can also be proved by the Cauchy's Convergence 
Theorem. That is 

Afi-l 

\\Z[k^]-Z[k2]h<\\Mki,0)-Mk2,0)\\F\\m\\2+ Yl \\Mki,s) - Mk2,s)\\F\\ud[s]h 

s=0 

fci-1 fc2 

+ Y^ ||<l>d(A;i,s) -$d(A;2,s)||F||wd[s]||2+ J^ ||$d(/i;2,s)||ir||a;d[s]||2 

s=Mi s=ki 

<2||Z[0]||2A^^e + 2N^Mde + 2N'^e + Nh. (33) 

From (132] ) and (|33T ), it can be obtained that there exists z* such that limfc^oo \zi ~ z*\ = 0, 
i = l,---,N. U 

The next Lemma bridges the discrete-time first-order integral multi-agent system and the orig- 
inal high-order multi-agent system, which plays a same role as its continuous-time counterpart 
(Lemma 121). 
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Lemma 4: Consider the following non-homogeneous linear difference equation 

r[k + m-l\ + bm-ir[k + m - 2] H h b2r[k + 1] + bir[k] = f[k], (34) 

where r[k] E M and f[k] is a convergent sequence satisfying lirak^oo f[k] = /*. Let the 
characteristic equation associated with (|7]) be 

S™-1 + brn-lS"^-^ + ■ ■ ■ &2S + &1 = 0. (35) 

Then, for any initial state (r[0],r[l], ■ ■ ■ ,r[m — 2]), r[k] is convergent to f*/{bi-\ h&m-i + l) 

if all roots of (|35T ) are in the unit circle. 

Proof: See the proof in the Appendix. ■ 

Theorem 3: Under the proposed consensus protocol defined by (ED, the discrete-time high- 
order multi-agent system defined by (|20] ) can reach a consensus if the communication topology 
Qfj[^ is uniformly jointly quasi- strongly connected in the discrete-time sense, all eigenvalues of 
A + KqC are in the unit circle and the control parameters (61, ■ ■ ■ , &m-i) in (ED are designed 
in such a way that all roots of (l35l) are in the unit circle. 

Proof: If Q^[k] is uniformly jointly quasi- strongly connected in the discrete-time sense, by 
Lemma [31 there exists 2;* G R such that limfc^oo^[^] = z*lj\f. Then by (1231) . lirak^oo Z[k] = 
lim,^oo(/^ ® K,)Z[k] = lim,^oo(/^ ® K,){{In ® {KeC{A + K,C)')){Z[0] - X[0]) +X[k]) = 
\iiak^oo{lN ® K^)X[k] since all eigenvalues of A + KqC are in the unit circle. Therefore, 
limfc_5.oo K^Xi [k] = z* which implies that 

Xi^i[k + m-l] + bm-iXi^i[k + m - 2] H h b2Xi^i[k + 1] + biXi^i[k] = /^[/c], 

lim/^[fc] = z*, z = l,---,N. (36) 

fc— >oo 

Since all roots of (|35T ) are in the unit circle, it follows by Lemma H] that limfc_j.oo a^i.iffc] = z*. 
Due to the relationship between Xj^i[A;], ■ ■ ■ , Xi^m[k], it can be proved that Hmfc_j.oo Xi[k] = z*1n, 
i = 1, ■ ■ ■ , A^, which closes the proof of this Theorem. ■ 

V. Simulation Examples 

In this section, three simulation examples are provided to validate the correctness of theoretical 
analysis. 
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A. Example One 

Consider a network of five identical single-link flexible-joint robots. A sketch of this robot is 
shown in Fig. [H According to [|30l . the ith robot is modeled by the following dynamics 

/g,,i(t) + M^L sin g,,i(t) + A;(g,,i(t) - qi,2{t)) = 0, 

(37) 

Jqi,2{t) - k{Qi,ii^) - QiAt)) = Ti{t), 
where gi,i(t) denotes the angle of the robotic link; qi^t) represents the angle of actuator; I and 
J denote the inertia of the actuator and robotic link, respectively; M is the mass of the robotic 
link; L represents the length between the mass center and the joint mounting point; k denotes 
the spring's torsion coefficient; rj(t) is the torque input. The communication topology switches 
between the following three cases (shown in Fig. |2]). o(t) = mod (lOt, 3) + 1. Then Vt > 0, 
the union graph Q[t,t+o.3) is quasi- strongly connected which means that Qa-(t) is uniformly jointly 
quasi-strongly connected. And «g^ = ag\ = ag^^ = 1; a^^ = '^gl = '^gt ~ -'-' '^gl ~ '^gt ~ 
Og' = 1; and all other ag = 0, i,j = 1, ■ ■ ■ , N,k = 1, 2, 3. The control objective is to design 



a distributed protocol for each robot to drive all robots' joints to a same angle, i.e., there exists 
g* and q* such that limi^oo qi,iit) = g* and limj_^oo qi,2it) = q2, i = I,- ■ ■ ,5. 
By the feedback linearization technique, let 

Xi,2{t) = qi,i(t), 

Xi,z{t) = -MgLsm{qi,iit))/I - k{qi^i{t) - qi,2{t))/I, 

Xi4t) = -MgLq,^i{t) cos(go(t))// - k{qi^i{t) - %2{t))/I, (38) 



and 



IJ [ ,^, MgL ._^ /.NN/.2 /.^ , MgL _^^ ^^^^ , k. 



n{t) = —iui{t)- — p sin(g,,i(t))(g/_i(t) + — ^ cos(gi,i(t)) + j) 



+ yte,iW - Q^,2imJ + J + ^cos(g,i(t))) ). (39) 



The nonlinear robotic dynamics defined by (1371 ) can be transformed into the following high-order 
integral dynamics 

ii,l(t) = Xi^2{t), Xi^2it) = Xi;s{t), Xi^s{t) = Xi,4(t), Xi^4{t) = Ui{t). (40) 
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Therefore, the consensus protocol Ui{t) in (|39l) can be designed according to (H). Ki and K2 
in dH) are set as Ki = (0,-1,— 3, —3) and K2 = (1,3,3,1). It is easy to verify that under 
these control parameters, all roots of (0 are in the open left-half complex plane. By Theorem 
[H the control objective can be achieved. In the simulation, the parameters in (1371 ) are set as 
follows: M = 1.5kg; g = Q.Sm/s^; J = 3.2kg-m2; / = Ikg-m^; L = 0.8m; k = 2.5N/deg. 
The initial joint configuration is set as gi,i(0) = 2.5deg, gi,2(0) = l.Sdeg, g2,i(0) = 1.9deg, 
g2,2(0) = 3.14deg, g3,i(0) = -2.4deg, ^3,2(0) = -2.6deg, g4,i(0) = 1.57deg, ^4,2(0) = -l.Sdeg, 
?5,i(0) = — 3.14deg, 55,2(0) = Odeg and gi,i(0) = ^1,2(0) = Odeg/s. The simulation results are 
shown in Fig.[3l It can be seen that Wmt^oo <ii,i{t) = — 3.255deg and Yrnvt^oo (ii,2{t) = — 2.723deg, 
which means that the consensus problem is solved. Therefore, the correctness of Theorem [His 
illustrated by this example. In addition, this example also shows that the consensus problem of 
some nonlinear multi-agent systems can be solved by combining the proposed protocol and the 
feedback linearization approach. 

B. Example Two 

This example studies the attitude consensus problem of a group of four aircrafts. The schematic 
diagram of the aircraft is shown in Fig. S] A simplified dynamical model of the aircraft vertical 
motion is introduced in [30]. That is 

Joii + hoii + {CzeI + Czwd)ai = CzE^Ei, (41a) 

mhi = {CzE + Czw)oti - CzEEi, (41b) 

where hi denotes the aircraft's attitude; Ei denotes the elevator rotation angle (control input); a, 
denotes the rotation angle of the aircraft about its mass center Co', b is the friction coefficient; 
Lw = CzwOii is the lifting force applied at the "center of lift" Cl, Le = CzE{Ei — ««) is the 
aerodynamic force on the elevator; m is the aircraft's mass and J is its moment of inertia about 
Cg- In [[30l . these parameters are set as J = 1, ni = I, h = 4, Cze = 1, Czw = 5, / = 3 and 
d = 0.2. Let Xi = {xi^i, Xi^2, Xi^3, Xi^i)'^ = {ai, ai, hi, hi)'^ , then equation (|4T]) can be written in 
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the form of ([IT]) with 

1 o\ 

-4-4 

1 

\ 6 0/ 

In this example, it is assumed that only the aircraft's attitude hi can be measured, which means 
that yi = CgXi = hi with Cg = (0, 0, 1, 0) in (flTl) . It is easy to verify that under these parameters, 
the attitude dynamics of aircraft is controllable and observable. The switch signal a(t) of the 
communication topology is cr(t) = mod (10t,4) + 1. And «g^ = 1 if Cji E Qk', otherwise 
0, z, j G {1, ■ ■ ■ , A^}, k e {1, 2, 3, 4}. And it is easy to see that Q^j^t) is uniformly jointly 



/o\ 

3 


v-v 



a 



Qk 



quasi-strongly connected. Therefore, by the analysis in Section IIII-Cl the attitude consensus can 
be reached if the parameters in (fT9T i are selected as follows 

K, = (0, -1, -3, -3), K2 = (1, 3, 3, l),K, = (1/3, -2/3, -6, -7)^, 
3 \ 



t; 



(0,-1 

/o 

3 

14 -4 -1 
\0 14-4 -ij 

In the simulation, four aircrafts' initial states are Xi(0) = (0, 0, 8000, 0)^, Xi(0) = (0, 0, 6500, 0)^, 
xi(0) = (0,0,7000,0)^, xi(0) = (0,0,5000,0)^; and the initial estimated states are si(0) = 
(0,0,10000,0)^, si(0) = (0,0,7000,0)^, si(0) = (0,0,6000,0)^, si(0) = (0,0,4000,0)^. The 
trajectory profiles of four aircrafts' real states and estimated states are displayed in Fig. |6l which 
implies that four aircrafts' attitudes reach a consensus. 



C. Example Three 

To validate the theoretical analysis in Section |IVl the consensus problem of a group of four 
discrete-time high-order integral agents defined by (|20T i is studied. The parameters in (EOl ) are set 
as m = 4 and C = (1,0, 0,0). The switching communication topology is similar with the one in 
Example Two {a[k] = mod {k, 4) + 1, fc = 0, 1, ■ ■ ■ )• The control gain vectors in (|2T) are set 

as Ki = (1/8,5/8,3/4,-1/2), iTj = (1/8,3/4,3/2,1) and Kq = (-2,-3/2,-1/2,-1/16)^. 
Then, all roots of (l35l) are in the unit circle. The initial states of four agents are randomly selected. 
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and the initial estimated states are set as O4. The trajectory profiles of Xj i[A;] (i = 1, 2, 3, 4) are 
given in Fig. Ul which illustrates the effectiveness of the proposed protocol defined by (IITT ). 

VI. Conclusion 

This paper studies the consensus of high-order integral multi-agent systems under the switching 
directed topology. The state-feedback based protocol and the dynamic output-feedback based pro- 
tocol are proposed to solve the consensus problem, respectively. It is noted that by the proposed 
approaches, the consensus of the high-order integral multi-agent system can be transformed into 
the consensus of the first-order integral multi-agent system if all roots of the polynomial ^ are 
in the open left-half complex plane. By using results in the robust consensus, it is proved that 
under both consensus protocols, the connectivity condition on the switching directed topology 
is only "uniformly jointly quasi- strongly connected", which is much weaker than the existing 
conditions. Finally, it should be noted that one most interesting contribution of this paper is that 
under the proposed protocols, there exists certain "equivalence" between the first-order integral 
multi-agent system and the high-order integral multi-agent system. Most results in the first-order 
integral multi-agent system can therefore be generalized to the high-order integral case, which 
deserves more investigation in the future. 

Appendix: Proof of Lemma [2] 
Proof: (Sufficiency) Let the roots of ([8]) be Ai, A2, ■ ■ ■ , Xm-i- Without loss of generality, it 
is assumed that Ai = ■ ■ ■ = Xk^, A^^+i = •■■ = A^i+fej, ■■•, X-^^^ik^+i = ■■■ = ^YlU^ki 
{I e N,l < I < m - l,k, e N,l < ki < m - 1, Xl'^i ki = m - 1). By the knowledge of 
differential equation, one particular solution of <U} can be written in the following form 






Jo Jo Jo 

(42) 

After obtaining the particular solution r*'(t), the general solution of dV]) can be expressed as 

follows 

Tit) = T^it) + EE^Epl'c,+.%W, R^m = t'-'e ^-^'^^"S (43) 

j=l i=l 

where Ci, ■ ■ ■ , Cm-i are coefficients to be determined by the initial state. 
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Next, let us study the limitation property of e'^* J^ e^'^^g{s)ds where A is a complex constant 
with negative real part and g(t) is a continuous function satisfying limi^oo5'(^) = 9*- Since 
limt_>oofi'(^) = 9*, for any e > 0, there exists ti > such that \g{t) — g*\ < e, Vt > ti. In 
addition, there exists a constant M < oo such that \g{t)\ < M, Vt > 0. Then 



e~^'g{s)ds + 



A 



^Ht-s) 



g{s)ds 



3^^'^'^q*ds + 



+ 



oHt-s) 



g{s)ds + 



h 



A 



< e^*M- 



-Aii 



tl 



A 



'i'^'-'\gis) - g*)ds 



A 



Since A has the negative real part, (1441) leads to 



< e^*M- 



-Ati 



A 



+ e 



A 

1 eA(t-ti)~ 



i— j-oo 



lime^* / .-As^/^Nj, ^ 



MsMs = -^. 



(44) 



(45) 



If Ai, ■ ■ ■ , Am-i are all in the open left-half complex plane and limt^oo f{t) = f*, applying 
451) to dUl) by (m - 1) times obtains that 

f* _f* 

nr=7'(-A.) «i' 



lim r^(t) 



t— >oo 



(46) 



In addition, if Ai, ■ ■ ■ , A^-i are all in the open left-half complex plane, then Rjiif) in (|43l) 
has the property that limi^oo Rji{t) = 0. Then it can be obtained that whatever the coefficients 
Ci, • ■ ■ , Cm~i are, r{t) in (|43l) always satisfies that limt_5.oo ^{t) = f* /ai. Furthermore, r'^^)(t) = 
d {rP{t) + E;=i THU C^-J.k^+^R^^H)) /dt. And 



(irP(t) 
dt 



Aie 



Alt 



,(A2-Ai)ri _ 



'^'-'f{r^-i)dr, 



+ e 



Aai 



e 



(A3-A2)ti 



m— 1 



(iri 



--^m-lf"m-2 



firm-2)dTm-2 ■ ■ ■ dTi. (47) 



Therefore, if Ai, ■ ■ ■ , Am-i all have the negative real parts, then limi_j.oo dr'^{t)/dt 



(-Ai)r 



ns'(-^o 



/* 



^_i = 0. And it can also be obtained that \im.t^oodRji{t)/dt = 0, which leads to 

lli=2 (~Ai) 

that limt__5.oo^''^''(i^) = 0. By the same analysis, it can be proved that limt_>.oo^''*''('^) = 0' 
z = 1, ■ ■ ■ , m - 2. Hence limt^^{r{t), r(i)(t), ■ ■ ■ , r(— 2)(t)) = {f*/ai, 0, ■ ■ ■ , 0). 



(Necessity) Let rg{t) = (r(t),r(^)(t), 
ing form 



,(m-2) 



(t))^, then (O can be rewritten in the follow - 
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r^t) 



( 1 


\-ai -a2 



A 




(^\ 


1 


r,{t) + 





Q-m-l/ 




^1/ 



f{t) = Arrg{t) + Brf{t). 



(48) 



Let the state transition matrix of (|48T ) be $r(i^, s) = exp{Ar{t — s)). Then rg{t) can be solved 
as rg{t) = $r(^, 0)rc,(0) + /^ ^r{'t,s)Brf{s)ds. If some roots of dS]) are not in the open left- 
half complex plane, by the knowledge of linear system, there exists at least one initial state 
rVO) such that $r(t,0)r^(0) is not convergent as t goes to infinity. Assume that under this 
initial state r^(0), we can still find a continuous function /i(t) satisfying \iiat~^oo hit) = f\ 
such that rg{t) = ^rit, O)rg(O) + /^ ^rit, s)Brfi{s)ds is convergent to r*. From the other side, 
let us consider another continuous function /2(t) = 2fi(t). Then under the same initial state 
^9(0), rg{t) + $^(t, O)ri(O) = 2^r{t, O)ri(O) + jl $^(t, s)Brf2{s)ds is convergent to 2r*. Since 
$r.(t, O)r^(O) is not convergent, rg(t) with f(t) = /2(t) in (l48l) is not convergent. This contradicts 
with that rg(t) is convergent for any initial state r^(0).B 

Appendix: Proof of Lemma [3] 

Proof: This proof is similar with the one of Lemma [1] Note that one particular solution to 
dllllis 



fc-i 



im-l — 1 



13-1 



i2-l 



«m-l=0 im-2=0 i2=0 h=0 

where {/xi, ■ ■ ■ , /im-i} are the roots of (1351 ). Assume that /ii = ■ ■ ■ = /x/i^, /i/n+i = ■ ■ ■ = Iihi+h2^ 
■ ■ ■ , /^j^'-i /j^+i = ■ ■ • = yU^!_ ^. (/ G N, 1 < / < m - 1, /ij G N, 1 < /ij < m - 1, X]i=i ^i = 
m — 1). Then the general solution r[k] to (l34l) can be written as a combination of r*'[A;] and 



D 



j«i 



k—i 



H/^E-1/^.+ij (1<J<U<^<M. 



From one hand, the following property holds for r^lk] 



fc-i 



lim /i^ E-^'^'/t^] = /V(l - /^), V|/x| < L 



fc^-OO 



i=0 



Since all roots of (1341) are in the unit circle, it follows that 



lim r^[k] 



fc— >oo 



n 



m— 1 , 



1 -/Ui 



/7(6™_i + --- + 6i + l). 



(50) 



(51) 
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From the other hand, it is easy to prove that \irak-yoo Dji[k] = (1 < j < I; I < i < hj) if 
all roots of (|35T ) are in the unit circle. 

Therefore, the general solution to (|34] ) is convergent to /*/(&m-i + ■ ■ ■ + &i + 1) regardless 
of the initial state. ■ 
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Fig. 1. A sketch of a single-link flexible-joint robot. 




(a) (b) (c) 

Fig. 2. Three possible communication topologies of the multi-agent system in Example One: (a) Qi; (b) Q2', and (c) Q3. 
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Fig. 3. The joint profiles of five single-link flexible-joint robots: (a) gi,i(i); (b) qi,2{t) i — 1, 




Fig. 4. A schematic diagram of an aircraft. 
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Fig. 5. Four possible communication topologies of the multi-agent system in Examples Two and Three: (a) Qi; (b) Q2', (c) 
G3; (d) 04. 
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Fig. 6. The trajectory profiles of four aircrafts' real attitudes and estimated attitudes: (a) the profiles of the real attitudes; (b) 
the profiles of the estimated attitudes. 
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Fig. 7. The trajectory profiles of four agents' first-dimensional states. 
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